WORM) I NT 1:1 .1 .1-XTI "A I. PROPERTY UK(iANI/.A HON 
International Bureau 




PCT 

IN"I T-RNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPER A 'HON TREATY (PCI) 



(51 ) Iiitcrn:iti<m;il Patent Classification h : 

H04N 7/24, 7/16 



Ai 



Ml) Inter national Publication Number: 



WO 99/39506 

August ivvy (Os.ox.'W) 



(21) International Application Nurnbvr: PCT/US9s>/00867 

(22) International Filing Date: 15 January 1999 (15.01.99) 



(30) Priority Data: 

60/073.106 



30 January 1998 (30.0 1.98) 



US 



(71) Applicant: GFNERAE INSTRUMENT CORPORATION 

[US/USI; 101 Tournament Drive. HorshnTh. PA 19044 
(US). 

(72) Inventor: SAFADI. Reem; 429 Brown Briar Circle. Horsham, 

PA 19044 (US). 

(74) Agent: LIPSITZ, Barry, R.; 755 Main Street. Monroe. CT 
06468 (US). 



(Hi) Designated .States: AI.. AM. AT. AT, AZ. R A, BR. BG. BP 
BY. CA, CH, CN. CU, CZ. D\'i. UK. PI;. ES. PI. GB. GO 
GE. OH. GVf. MR. tiU, ID, IL, IN, IS, JP, KE, KG. KP 
KR, KZ. IX, UK. PR, LS, ET, EU. LV, MD. MG, MK 
MN, MW. MX, NO. NZ, PI,, PT. RO, RU, SD. SE. SC.. 
SI. -SK. Tf. TM. TR. TP UA. UG. UZ. VN. YE'. Z\V 
AKIPO patent (CM, GM, KE, ES. M\V, SD. SZ. EG. 7.W) 
Eurasian patent (AM. AZ. BY. KG. KZ, MD. RU. TJ. TM) 
European parent (AT BE, CI I. CY, DE, DK. ES, PI. PR 
GB. GR. IE. (T. EU. MC, NL. PT. SE). OAPI patent (BP. 
BJ. CP, CO. CI. CM, OA, GN. GW, ME. MR. NE, SN 
TD. TG). 



Published 

With intcrnaiirmai search rep on. 



(54) Title: APPARATUS AND METHOD FOR DIGITAL ADVERTISEMENT INSERTION IN A BITSTREAM 



EMCooewwux 



ANALOG 
PROGRAMMING INPUT 



AVO 

COMPRESSOR 



CUE TONE 
OCTECTOR 



313 



M'TS 



cue 

OOMMANO 
DETECTOR 



"ST 



A 

J«5 



MOOOLATOR 



- CONTROL StCNALS 
-FROM UPLINK 
_ NETWORK 1 60 



IK»CRTER 140 ~* 

(57) Abstract 

A system for inserting commercials O-*®) into an audiovisual bit stream by providing cue commands (.320) in response to cue 
tones (315) in a pre-existing analog signal. anaVor in response to control signals from an uplink (/programmer/network) site (100) or 
headend (./affiliate) (200). Firmware upgrades are provided to a digital encoder (120) to facilitate generating spliceable bit streams and 
generation of cue commands. This enables commercial insertion at an uplink site (/programmer/network) (100) as well as at a cable 
television headend (/affiliate) (200). The system provides functional compatibility between a digital bit stream (150) and the analog cue 
tones. The cue commands are preferably carried in the transport layer of the bit stream so there is no need to decode and process several 
layers of the bit stream. Accordingly, a new commercial insertion capability can be added to existing uplink and headend equipment in a 
backward compatible manner minimizing upgrade-related expenses, yet allowing different splicing techniques to be employed depending 
on cost-performance tradeoffs in terms of desired post-splicing audiovisual quality. 
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APPARATUS AND METHOD FOR DIGITAL 
ADVERTISEMENT INSERTION IN A BITSTREAM 



BACKGROUND OF TJ-fE INVENTION 

This application claims the benefit of U.S. 
5 provisional patent application serial no. 

60/073,106, filed January 30, 1998. 

The present invention provides a system 
approach to digital advertisement insertion in a 
television signal or the like that is consistent for 

10 both satellite television uplinks and cable 

television headends , The invention is particularly 
adapted for use with analog television signals that 
are subsequently digitized, e.g., using an MPEG-2 
compression system . 

15 Analog television signals are commonly 

broadcast over satellite links to headends of cable 
television networks or affiliate sites of 
Broadcaster's network. The term "headend" is used 
hereafter even though the same applies to an 

20 affiliate site. Programming signals from different 

cable or television networks (e.g., CNN, ABC) are 
provided with cue tones, which signal the start and 
end of a message break period during which 
commercials may be run. Each network generally has 

25 a unique cue tone which occurs a few seconds before 

the start and end times of the insertion window. 

For example, the network signal may leave blank 
air time during this period to allow the headend to 



WO 99/39506 



PCT/US99/00867 



10 



insert commercials of local interest when the cue 
tones are detected. Typically however, the 
network's national commercial may get replaced by a 
local commercial if the window or pare of it allows 
such replacements and a replacement is available 
locally. The commercials may be paid 

advertisements, unpaid public service announcements, 
or the like. The content may be video, audio, 
and/or other data (e.g., HTML pages with hyperlinks, 
etc.). Note that in the data-only case, the 
original programming (with or without a national ad) 
may be left intact with locally originated data 
added as supplementary information to the original 
content. For example, web- supported ads, with 
15 locally generated web pages, can be facilitated. 

The bandwidth requirements for insertion of such 
data are minimal. Regardless, the required 
bandwidth would have been allocated a priori. 

The cable headend operator may use automated 
20 equipment that controls video tape players and 

positions the local commercial or other messages for 
playback and insertion when cued at the proper time. 

Or, the network signal may include its own 
commercials which can optionally be electronically 
25 pre-empted by the local insertions 

Typically, the message break (window) is one or 
two minutes in duration, which allows a number of 
commercials. Commercial or "spot" durations vary. 
Some are fifteen seconds or less, while others are 
30 . thirty seconds, sixty seconds, etc. 
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Currently, however, broadcasting of .digital 
audiovisual content has become increasingly popular 
in cable networks and soon in TV broadcast networks, 
and is expected to gradually supplant the analog 
5 schemes. Various^ standards have been developed for 

the communication of digital audiovisual content , 
such as the MPEG-2 standard- Moreover, MPEG-2 
provides a framework, albeit incomplete, for 
splicing of transport streams, discussed in "Revised 

10 Text for ITU-T Recommendation H. 222.0. | ISO/IEC 

13818-1, Information technology - Generic coding of 
moving pictures and associated audio information: 
Systems," ISO/IEC JTC l/SC 29, April 27, 1995, pp. 
135-138 (Annex L - Splicing Transport Streams) . 

15 The MPEG-2 standard provides syntax elements 

that are relevant to splicing in a transport packet 
adaptation field. The syntax elements include a 
splicing_point_^f lag, which is a single bit that 
indicates whether a splice_countdown field is 

20 present. The splice_countdown field is used to 

count down how many packets of the same packet 
identifier (PID) occur before the splice point. 
Additionally, the transport stream packet in which 
the splice_countdown field value reaches zero is 

25 called the splicing packet. The splicing point is 

located immediately after the last byte of the 
splicing packet. 

However, some of the past proposals to 
complement the MPEG-2 capability required decoding 

30 of several of the data layers in the digital 

transport stream to obtain information regarding 
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timing (e.g., time stamp values) and buffer fullness 
status to allow a successful commercial insertion, 
in another approach, the entire data stream, 
including video and audio, is decoded in a manner 
that maintains some of the original encoding 
parameters. Then, a commercial is inserted into the 
decoded stream, and the stream is re-encoded using 
the conveyed parameters which were obtained during 
decoding. The intent was to enable more efficient 
re-encoding when compared to re-encoding without 
these parameters. 

Moreover, such digital splicing schemes do not 
take into account the operational requirements 
associated with cue tones in the analog domain, nor 
the various operations that may be applied to the 
stream prior to commercial insertion, e.g., add/drop 

multiplexing. 

Additionally, there already exists an installed 
base of equipment, including encoders and 
transcoders, for digital television distribution, 
that in many cases does not support the MPEG- 2 and 
other complementary splicing syntax. It would not 
be economical to redesign and replace such existing 
equipment to support the MPEG-2 splicing format. 

Accordingly, it would be desirable to provide a 
system for inserting commercials in a digital 
television transport stream that is compatible with 
the operational aspects of pre-existing cue tones in 
analog television signals. 

The system should avoid the need to decode and 
re-encode several data layers in a digital transport 
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stream to obtain information regarding timing and 
buffer fullness status to allow a successful 
commercial insertion, thereby simplify and reducing 
the costs of required insertion equipment . 

The system -should be backward-compatible with 
equipment such as encoders, transcoders, and the 
like, that are already deployed by various cable 
television and satellite television service 
providers. Moreover, the system should be able to 
be implemented with only minor firmware upgrades to 
existing equipment, which is particularly 
advantageous when compared to integrated commercial 
insertion solutions . 

The system should allow the use of splicers of 
varying seamless splicing capability, and should 
have a relatively minimal impact on the other 
devices at the uplink or headend (.e.g., encoder, 
transcoder) . 

The system should further allow add/drop 
multiplexing prior to, or as part of, commercial 
insertion . 

The system should provide compatibility between 
satellite television uplinks and cable television 
headends. 

The system should ensure that decoders in 
consumers' homes are splice-unaware (i.e., unaware 
of the presence of spliced data) . This is to avoid 
having to replace these decoders and to prevent the 
enabling of "commercial killer 1 ' devices which detect 
and block out commercials. 



WO 99/39506 



PCT/US99/00867 



6 



The system is preferably compatible with 
constant bit rate (CBR) and variable bit rate (e.g., 
including statistically multiplexed) streams. In 
other words, the inserter, depending on its type may 
5 operate on CBR streams for insertion, or add/drop 

(insert) into statistically multiplexed streams. 
The system described herein applies to both cases. 

The present invention provides a system having 
the above and other advantages. 
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SUMMARY OF THE INVENTION 

The invention relates to a system for inserting 
commercials into a digital television signal using 
cue commands. A.xue command is functionally 
analogous to a cue tone but instead of a dual- tone 
multif requency (DTMF) implementation of the 
cue_t one , it is implemented as a protocol message 
that is understood by the inserters (splicers) . 

A method for inserting digital commercials into 
a digital audiovisual bitstream includes the steps 
of: processing a first audiovisual signal to 
determine whether cue tones are present therein, 
encoding the first audiovisual signal as a digital 
spliceable data stream, and providing cue commands 
corresponding to the cue tones, if present, in the 
digital spliceable data stream. The cue commands 
indicate splicing points for splicing a digital 
commercial into the digital spliceable data stream. 

The term "audiovisual" is used to represent a 
signal including video, audio, and/or other data, 
including, but not limited, to a television signal. 

The digital spliceable data stream is forwarded 
to a commercial inserter, which detects the cue 
commands and inserts a commercial into the digital 
spliceable data stream in response thereto at a 
splice point designated by a first detected cue 
command, and monitors the digital spliceable data 
stream for a subsequent cue command to splice back 
from the inserted commercial to the original digital 
spliceable data stream. 
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A plurality of single video program transport 
streams, including the digital spliceabie data 
stream, may be multiplexed into a mult i. -program 
transport stream, and the multi-program transport 
5 stream forwarded to the commercial inserter. 

In this case, the multi-program transport 
stream is forwarded to a commercial inserter, which 
detects the cue commands and inserts a commercial 
into the digital spliceabie data stream in response 
10 thereto at a splice point designated by a first 

detected cue command, and monitors the multi-program 
transport stream for'a subsequent cue command to 
splice back from the inserted commercial to the 
multi-program transport stream. 
15 The first audiovisual signal may be an analog 

signal, in which case it is digitized and compressed 
to provide the digital spliceabie data stream. 

The cue commands are provided at the uplink 
site, or a remote studio site, while the commercials 
20 may be inserted at the uplink site and/or at a 

headend. In some cases, the digital audiovisual 
signal is originated locally from a server located 
in the headend. 

Preferably, the cue commands are provided as a 
25 message in the digital spliceabie data stream in a 

transport layer such that they may be readily 
detected by the inserter without having to decode 
several layers of the data stream. 

Furthermore, the cue commands may designate 
30 desired or required program attributes of the 

inserted commercial, such as bit rate, and stream 
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construct, such as number of audio streams, and the 
like . 

Moreover, even if no cue tones are detected, 
the cue commands may be provided in response to a 
5 local network dey4.ce, such as a real-time trigger or 

a scheduler/controller that is co-located or 
remotely located in a studio site. 

An example syntax of such cue commands which 
may be used with the present invention is discussed 
10 in "Proposed SMPTE Standard for Television - Splice 

Points for MPEG-2 Transport Streams, " SMPTE-312M, 
SMPTE Journal, Oct. 1998., incorporated herein by 
reference . 

The digital spliceable data stream may be a 
15 constant bit rate stream or a variable bit rate 

stream . 

A corresponding apparatus is also presented. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a digital television uplin: 
site in accordance with the present invention. 

FIG. 2 illustrates a. digital television heade 
in accordance with the present invention. 

FIG. 3 illustrates details of the uplink site 
of FIG. 1 in accordance with the present invention 

FIG. 4 illustrates details of the headend of 
FIG. 2 in accordance with the present invention. 
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DETAILED DESCRIPTION OF THE INVENTION 



The invention relates to a system for inserting 
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commercials into a digital television signal using 
cue tones . 

FIG. 1 illustrates a digital television uplink 
site in accordance with the present invention. The 
uplink site 100 receives an analog television 
programming input, e.g., from a programmer studio 
via a terrestrial or satellite communication link. 
Or, the programming input may be locally generated. 
Some or all of the analog television signals have 
cue tones as they are known in the art for signaling 
the start and end of a period for inserting one or 
more commercials. 

The term "commercial" or n ad" is used herein to 
represent any message break, whether paid or unpaid, 
including paid advertisements (ads) , unpaid public 
service announcements, news and weather messages, 
and the like, that is provided between regular 
programming segments . 

The term "splice point" is used to designate a 
point where a commercial insertion is to begin or 
end . 

The analog programming input is provided to an 
encoder/multiplexer (mux) 120 for digitizing and 
encoding according to MPEG-2 or a similar digital 
television standard. Typically, several analog 
programs are encoded at the encoder/mux 120 to 
provide corresponding single program transport 
streams (SPTSs) which are subsequently multiplexed 
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together to form a multi-program transport stream 
(MPTS) . The MPTS is provided to the inserter. (s) 140 
when it is desired' to insert either commercials 
and/or cue commands in accordance with the present 

5 invention. 

Note that in other configurations, a single 
program transport stream may be output from one 
program stream encoder and then each such output is 
forwarded to a multiplexer to generate a MPTS. The 
10 inserter may insert into a SPTS or a MPTS. The 

former is a degenerate case of the latter, and as 
such the MPTS is referenced hereafter. 
The inserter (s) 140 may be configured in such a 
manner that the encoder unconditionally outputs the 
15 MPTS to the inserter. The inserter, in turn, 

determines whether to insert a commercial or pass 
the MPTS through intact (e.g., unchanged). The 
inserter's decision is based on the presence of the 
cue command (or lack thereof) . 
20 Note that the figures show a functional 

partitioning that is not necessarily physical. For 
example, the encoder 120 (as a product) may 
encompass the following functions: the capability 
for digitizing, encoding, multiplexing, and 
25 encrypting and modulating as one physical box. 

Alternatively, as mentioned before, the digitizing 
and encoding functions of a single program stream - 
may be modularized independently from the 
multiplexing (of the single program streams into 
30 multiple program streams) , from the encryption 

function, or from the modulation function. 
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within an inserter. (s) 
s imul taneous commercial 
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15 



20 



25 



insertion into more than one program. 

The inserter(s) 140 receive a digital 
commercial input- from an ad server 150, which 
includes a storage medium 155 for storing the 
commercials, such as MPEG-2 ads. The storage medium 
may comprise any known magnetic or optical storage 
device, for example. The commercial content may be 
stored in a pre- compressed format, in which case it 
can be provided directly to the inserter (s) 140. If 
the stored commercial content is not pre - compressed , 
or is even analog, appropriate digitizing and/or 
compression circuitry should be provided, depending 
on the cost aspects of the system when compared to 
analog insertion into an analog audiovisual signal 
and then encoding the resulting signal (with the 
commercial ) . 

The commercial content may itself be- partially 
encoded to allow future encoding (total compression) 
by varying the quantization parameters. This enables 
rate adaptation such that the commercial content 
fits the bandwidth allocated for the program to 
which the commercial belongs. Rate adaptation, as 
described, may take place in advance of the 
commercial, and as such may be facilitated as an 
off-line, non-real time process. 

Based on a control signal from an uplink 
network 160 on a path 147, the inserter(s) 140 may 
be instructed to insert the commercial content into 
the MPTS received from the encoder/mux 120. The 
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MPTS with the inserted commercial content is then 
provided to the encryptor/tnodulator 130 for 
conventional encryption processing, which is 
optional, and modulation. The encrypted MPTS is 
5 then provided to a satellite transmitter 190 for 

transmission to the headend of a cable television 
network via satellite, for example, as discussed in 
connection with FIGs 2 and 4 . 

Control signals are provided to the encoder/mux 
10 120 and the encryptor/modulator 130 from the uplink 

network 160 via a path 145. 

The uplink network 160 also communicates with 
the ad server 150, a real-time trigger 170, and 
schedule controller system 180. One scheduling 
15 system and other management controllers 180 may be 

provided for all inserter(s) 140 and for the 
encoder/mux 120 and encryption/modulation function 
130. The real-time trigger 170 may provide a signal 
to the inserter (s) 140 and/or encoder/mux 120 
20 requiring the insertion of a commercial and/or a cue 

command immediately, or at any specified time based 
on a clock associated with a common "house" clock 
reference is used which, for example, may be based 
on a Global Positioning System (GPS) clock or a 
25 SMPTE clock, or a real-time (manual) trigger. For 

example, it may be desired to insert a commercial 
and/or a cue command at a time that is not specified 
by a cue tone . Note that a cue command may be 
inserted into the MPTS without inserting any 
30 commercial content at the uplink site 100. There 

may already be commercial content or a blank period 
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in the MPTS that is subsequently replaced by 
commercial content at the headend. 

The scheduler/controller ( s ) may communicate 
with the inserter (s) 140, encoder/mux 120 and/or 
encryptor /modulator 130 as required to control the 
respective devices, to maintain a record of inserted 
commercials and cue commands, and to maintain and 
follow a schedule for providing future commercials 
and cue commands. The scheduler/controller ( s ) 180 
may provide a control signal to the inserter(s) 140 
to pass the data stream through unchanged. 

The scheduler/controller (s) 180 may monitor and 
detect the status of the inserter (s) 140 to 
determine whether a commercial has been inserted, or 
if an error has occurred. It may also configure the 
inserter(s) 140 for a specific time-out value that 
should be used whenever a second cue_command is not 
detected within the prescribed time limit. 

At the uplink site 100, a method of applying 
the invention includes the following steps: 

1. The encoder/mux 12 0 encodes a given analog 
signal as a spliceable MPEG-2 compressed stream. If 
the input signal contains any cue tones, the encoder 
converts them to cue commands that may later be used 
by the uplink inserter (s) 140 or the headend 
inserter (s) 220. The encoder input can also be an 
uncompressed digital bit-stream (e.g., corresponding 
to the CCIR 601 standard) . 

2. The encoder multiplexes single program 
transport streams (SPTS) into a mult i -program 
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transport stream (MPTS) and forwards the MPTS to the 

inserter 140 . 

3. The inserter 140 detects the insertion 
command for: a splice point and inserts the 
commercial.' Note that the inserter itself may 
forward the detected cue_command to the ad server 
150 for any processing (e.g., re-quantization 
transcoding) to prepare the commercial for 
insertion. In this case, the cue command is 
provided typically in advance of the actual 
insercion_time. In fact, the cue command may be 
provided well in advance of the splicing time, e.g., 
one-half hour, as well as just before (a' few 
second), or simultaneously with, the splicing time. 
The cue command also includes descriptive parameters 
pertaining to the program attributes that the 
commercial must. match (e.g., rate, stream construct 
such as number of audio streams, etc.) 

4. The inserter monitors the stream for the 
second cue command (or until it times out) to splice 
back to the original multiplex. 

5. The output of the inserter is passed to 
the encryptor/modulator 130. 

6. Moreover, note that the cue commands may 
25 be inserted into a SPTS in the alternate 

configuration where SPTS are created and then 
multiplexed in a separate multiplexing module. 

FIG. 2 illustrates a digital television headend 
in accordance with the present invention. The 
headend 200 includes a satellite receiver 205 for 
receiving the MPTS from the uplink site 100 of FIG. 



20 



30 
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1. A transcoder 210 is commonly provided to receive 
the satellite signal, demodulate it, apply error 
correction, decrypt and re-encrypt for local 
distribution, and modulate it after applying forward 
5 error cor rec t iort^f or transport over the cable 

network . 

The transcoder 210 provides a decrypted pre- 
insertion MPTS to inserter(s) 220, which are 
analogous to the inserter (s) 140 at the uplink site 

10 100. The inserter (s) 220 insert pre-compressed 

digital commercial content from an ad server 230 
which has a storage medium 240, e.g., for MPEG-2 
ads, and provides the result ing. MPTS back to the 
transcoder 210 for optional encryption. The 

15 inserter may output an unencrypted post - insert ion 

MPTS . A modulator may be provided at the inserter 
220, or a modulator at the transcoder 210 may be 
used without applying encryption there. 

Alternatively, the inserter 220 may forward the 

20 detected cue command to the ad server 230 for any 

processing (e.g. , re-quantization transcoding) to 
prepare the commercial for insertion. In this case, 
the cue command is provided typically in advance of 
the actual insertion time, and the cue command may 

25 also include descriptive parameters pertaining to 

the program attributes that the commercial must 
match (e.g., rate, stream construct such as number 
of audio streams, etc.) . In any case, once the cue 
command has been processed, the inserter deletes it 

30 to prevent commercial killers from detecting the 

commercial . 
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The ad server 230 is analogous to the ad server 
150 of FIG . 1. An encrypted post - insert ion MPTS is 
output from the transcoder 210 and provided to a 
population of conventional set-top terminals via, 
5 e.g., a cable/fiber network using conventional 

techniques.- If no insertion equipment is present, 
and thus the transcoder 210 does not forward its 
decrypted output to an inserter, the transcoder 210 
should delete the cue__command to prevent downstream 

10 commercial killers from detecting commercials that 

have been inserted beforehand (i.e., a local 
commercial did not replace the national commercial) . 

For the case where the programming is 
originated locally from a server, the output of the 

15 server may be forwarded to the inserter. In this 

case the inserter is instructed by the controllers 
when to insert a commercial. In some case the 
server and the inserter functions may be integrated 
as one physical product. However the physical 

20 partitioning has no bearing on the functional- steps 

that are required. 

Scheduler/controller ( s) 260, analogous to the 
scheduler/controller (s) 180 of FIG. 1, communicates 
with the ad server 230, and with the transcoder 210 

25 and inserter (s) 220 via a headend network 250. 

The MPTS provided by the headend 200 to the 
set-top terminals contains commercial content 
provided by any combination of : the original analog 
programming input, the uplink site ad server, and 

30 the headend ad server. Moreover, insertion of 

commercial content at either the uplink site or the 
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headend is initiated by a cue command signal that is 
provided according to cue tones that may be present 
in the original analog programming input, and/or 
according to a control signal from the 
5 scheduler/controller at the uplink site 100 or the 

headend 200. 

At the headend 200, a method of applying the 
invention includes the following steps: 

1. The multi-program transport stream (MPTS) 
10 is first received by the transcoder 210. 

2. The transcoder 210 decrypts the 
appropriate programs within the multiplex and 
forwards them to the inserter 220. 

3. The inserter 220 processes the cue 
15 commands and detects the splice point. It may 

forward the cue__command to the ad server 230 for 
commercial processing in advance of the insertion 
time . 

4. Once the inserter 220 has detected the 
20 splice point, it deletes the cue command from the 

stream and inserts the commercial (s) 

5. The inserter monitors the stream for the 
second cue command (or until it times out) to splice 
back to the original multiplex. 

25 6. The output of the inserter is fed back to 

the encryptor/modulation 130 for encryption and 
modulation 

FIG. 3 illustrates details of the uplink site 
of FIG. 1 in accordance with the present invention. 
30 Like-numbered elements correspond to one another. 

In the encoder/mux 120, the analog programming input 



WO 99/39506 ' PCT/US99/00867 

2 0 



is provided to an analog - to-digital (A/D) converter 
and compressor 305, and to a cue tone detector 315. 
The compressor performs convent ional audio and video 
encoding and compress ion , including mot ion 
5 est i mat ion and compensation, a spatial transform 

such as the DCT, quantization, variable length 
coding, and so forth. The cue tone detector uses 
known technology to detect the presence of cue 
tones . In response to such detection, a signal is 

10 provided to a control 320, which in turn generates a 

cue command message (e.g., a protocol message, that 
may span one or more MPEG-2 sections) and/or mux 310 
for insertion into the digitized bit stream. 

However, even if no cue tone is detected, the 

15 control 320 may provide the cue command message to 

the compressor 305 or the mux 310, depending on the 
desired splicing technique, in response to a control 
signal received from the uplink network 16 0 (e.g., 
from the real-time trigger 170, or the 

2 0 scheduler/ controller ( s ) 180 ) . Moreover, a digital 

programming input can also be accommodated with the 
present invention by bypassing the compressor and 
analog- to-digital (A/D) converter 305 . No cue tone 
will be present in such a digital input , so the cue 

25 tone detector 315 can also be bypassed. The control 

320 can still cause a cue command to be inserted 
into the digital input at the mux 310, e.g., in 
response to a control signal received from the 
uplink network 160 or a local scheduler/controller 

30 or real-time trigger. 
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The cue command signal is inserted in the 
transport layer of the bit stream so that it can be 
immediately detected without having to decode and/or 
decompress several layers of the bit stream. 
5 Additionally the^encoder creates and adjusts the 

splice point parameters for subsequent splicing by 
the inserter. 

Essentially, the digital cue command replaces 
the analog cue tone to signal the start and end of a 

10 commercial insertion period. 

Encoded bit streams (from an analog input or an 
uncompressed digital input) are provided from the 
compressor 305 to a mux 310 to obtain an MPTS, which 
is then provided to the inserter 140. A cue command 

15 detector 335 detects the presence of the cue command 

the transport layer of the MPTS and processes the 
content of the cue command to prepare for insertion. 
Depending on the content of the cue command, the 
inserter 140 may forward it to the ad server for 

20 further processing 

A control 330 associated with the cue command 
detector 335 causes a splicer 340 to insert the 
commercial content (ad input) into the MPTS 
according to the detection of the cue command and 

25 splice point detection in the stream. An MPTS with 

the inserted commercial content is then provided to 
the encoder/mux 120 for processing by the (optional) 
encryptor 360 and the modulator 365 for transmission 
to a headend. When no cue commands are detected at 

30 the cue command detector 335, the MPTS passes 

through the splicer 340 unchanged. The output of 
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the modulator 365 is an encrypted or an unencrypted 
MPTS . 

Note that the encryptor 360 and modulator 365 
are shown here as being physically part of the 
5 encoder/mux 12 0-- However, this arrangement is 

ootional. Moreover, the cue tone detector 315 and 
control 320 are also shown as being physically 
separate from the encoder/mux 120. However, again 
this is optional depending on the configuration and 
10 capabilities of the original equipment. 

The inserter 140 is responsive to control 
signals from the uplink network 160 (e.g., from the 
real-time trigger 170, or the 
scheduler/controller ( s ) 180) . 
15 Note that the mux 310 may alternatively be used 

after the inserter 140 so that commercial and cue 
command insertion occurs for the individual single 
program transport streams (SPTSs) . This may or may 
not be readily supportable depending on the encoder 
20 implementation . 

FIG. 4 illustrates details of the headend of 
FIG. 2 in accordance with the present invention. 
Like -numbered elements correspond to one another. 

The transcoder 210 receives the MPTS from the 
25 uplink site and provides it to a demodulator 

applying error correction 405 and a decryptor 410, 
if necessary. The demodulated and decrypted MPTS is 
forwarded to the inserter 230. 

At the inserter 230, cue commands in the MPTS 
30 are detected at a cue command detector 445. In 

response to the presence of the cue commands, a 
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control 440 commands a splicer 450 to insert: 
commercial content from the local ad server into the 
MPTS . When no 'cue commands are detected at the cue 
command detector 445, or from an external source, 
the MPTS passes -through the splicer 450 unchanged. 
The inserter may forward the detected cue_command to 
the ad server 155 for any required processing, as 
previously mentioned. However, even when no cue 
commands are detected at the cue command detector 
445, a control signal from the headend network 
(e.g., from scheduler /control ler 260 in FIG. 2) may 
command the splicer 450 to. insert commercial content 
from the local ad server into the MPTS. 

The headend may further employ a real-time 
trigger such as the trigger 170 used at the uplink 
site, e.g., for inserting emergency messages, or 
other special messages of local interest. 

Note that, the inserted commercial content may 
or may not overwrite existing commercial content or 
programming. For example, if the inserted 
information is complementary data such as HTML 
pages, the audiovisual content of the original 
stream may be left intact. 

The unencrypted MPTS from the inserter 230 is 
provided to the transcoder 210 for processing by the 
(optional) encryptor 415 and a modulator 420. The 
encrypted or unencrypted MPTS that is provided to 
the set-top terminals conforms to the digital- 
television standard used, such as MPEG-2, and can 
therefore be recovered, decoded and displayed in a 
conventional manner by the set-top terminals. 



WO 99/39506 



PCT/US99/00867 



2 4 



Accordingly, it can be seen that the present 
invention provides a system for inserting 
commercials into a digital television bit stream by 
providing cue commands in response to cue tones in a 
pre-existing analog signal, and/or in response to 
control signals from an uplink site or headend. 
Moreover, the cue commands are preferably carried in 
the transport layer of the bit stream so there is no 
need to decode, process, and re-encode several 
layers of the bit stream. 

Accordingly, a new commercial insertion 
capability can be added to existing uplink and 
headend equipment without requiring expensive 
upgrades 

In particular, appropriate firmware upgrades 
are provided to the encoder to partition the 
splicing/insertion function between the encoder and 
the inserter. This enables commercial insertion at 
the uplink as well as the headend. If the input to 
the encoder is an analog signal, the encoder (or an 
external device) detects the cue commands and insert 
them in the multiplex for local insertion. 

Other variations of the method are also 
possible. For example, the inserter 230 itself may 
consist of multiple cascaded inserters or splicers. 
The number of inserters may depend on the number of 
ad-supported programs (services) within a given 
multiplex. 

Although the invention has been described in 
connection with various specific embodiments, those 
skilled in the art will appreciate that numerous 
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adaptations and modifications may be made thereto 
without departing from the spirit and scope of the 
invention as set forth in the claims. 

For example, while the invention was discussed 
in connection wi>h a cable or satellite television 
broadband communication networks, it will be 
appreciated that other networks such as wide area 
networks (WANs) , and virtual private networks over 
the Internet may be used to transport the content to 
be inserted (presently, in non-real time fashion) . 
As the multicast real-time delivery of the 
audiovisual content over packet-based networks 
(e.g., using the Internet Protocol) matures, both 
programming as well as the commercial content may 
traverse these networks . However such embodiments 
provide additional insertion opportunities, some of 
which are synergistic to what 1 s been described, and 
others provide alternate paradigms. 

Additionally, the invention is compatible with 
digital video standards other than MPEG-2. 
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What is claimed is : 

1. A method for inserting digital commercials 
into a digital audiovisual bitstream, comprising the 
steps Of: 

processing a first audiovisual signal to 
determine whether cue tones are present therein; 

encoding said first audiovisual signal as a 
digital spliceable data stream; 

providing cue commands corresponding to said 
cue tones, if present, in said digital spliceable 
data stream; 

said cue commands indicating splicing points 
for splicing a digital commercial into the digital 
spliceable data stream; and 

forwarding the digital spliceable data stream 
to a commercial inserter; wherein: 

said commercial inserter detects said cue 
commands and inserts a commercial into said digital 
spliceable data stream in response thereto at a 
splice point designated by a first detected cue 
command; and 

said commercial inserter monitors said digital 
spliceable data stream for a subsequent cue command 
to splice back from the inserted commercial to the 
digital spliceable data stream. 

2. The method of claim 1, comprising the 
further steps of: 

multiplexing a plurality of single video 
program transport streams including said digital 
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spliceable data scream into a mult i -program 
transport stream; and 

forwarding the multi-program transport stream 
to the commercial inserter. 

3. The method of claim 1, wherein said first 
audiovisual signal is an analog signal, comprising 
the further step of : 

digitizing said analog signal to provide said 
digital spliceable data stream. 

4. The method of claim 2, wherein: 

said cue commands are provided in said digital 
spliceable data stream at an uplink site; 

said plurality of single video program 
transport streams including said digital spliceable 
data stream are multiplexed into the multi-program 
transport stream at said uplink site; and 

the multi-program transport stream is forwarded 
from said uplink site to said commercial inserter at 
a headend. 

5. The method of claim 2, wherein: 

said cue commands are provided in said digital 
spliceable data stream at an uplink site,* 

said plurality of single video program 
transport streams including said digital spliceable 
data stream are multiplexed into the multi-program 
transport stream at said uplink site; and 

the multi-program transport stream is forwarded 
to said commercial inserter at said uplink site. 



WO 99/39506 



28 



PCT/US99/00867 



method of claim 1, wherein: 
commands are provided in a transport 
digital spliceable data stream. 

7. The method of claim 1, wherein: 
cue commands are provided in said digital 

spliceable data stream regardless of a presence 
said cue tones according to a real-time trigger 
scheduler/controller . 

8. The method of claim 1, wherein: 
said cue commands designate desired program 

attributes of the inserted commercial. 

9. The method of claim 1, wherein: 
the digital spliceable data stream is a 

constant bit rate or a variable bit rate stream. 

10. An apparatus for inserting digital 
commercials into a digital audiovisual bitstream, 
comprising : 

a cue tone detector for processing a first 
audiovisual signal to determine whether cue tones 
are present therein; 

an encoder for encoding said first audiovisual 
signal as a digital spliceable data stream; 

a control responsive to said cue tone detector 
for providing cue commands corresponding to said cu 
tones, if present, in said digital spliceable data 
stream; 



6 . The 
said cue 
layer of said 



of 

or a 



WO 99/39506 PCT/US99/00867 



said cue commands indicating splicing points 
for splicing a digital commercial into the digital 
spliceable data stream; 

a commercial inserter; and 

means for forwarding the digital spliceable 
data stream to said commercial inserter; wherein: 

said commercial inserter detects said cue 
commands and inserts a commercial into said digital 
spliceable data stream in response thereto az a 
splice point designated by a first detected cue 
command; and 

said commercial inserter monitors said digital 
spliceable data stream for a subsequent cue command 
to splice back from the inserted commercial to the 
digital spliceable data stream. 

11. The apparatus of claim 10, further 
comprising : 

a multiplexer for multiplexing a plurality of 
single video program transport streams including 
said digital spliceable data stream into a multi- 
program transport stream; and 

means for forwarding the multi-program 
transport stream to the commercial inserter. 

12. The apparatus of claim 10, wherein said 
first audiovisual signal is an analog signal, 
further comprising : 

means for digitizing said analog signal to 
provide said digital spliceable data stream. 
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13. The apparatus of claim 11, wherein: 

said control and said multiplexer are provided 
at an uplink site; and 

said commercial inserter is provided at a 
headend . 

14. The apparatus of claim 11, wherein: 
said control, said multiplexer, and said 

commercial inserter are provided at an uplink site. 

15. The apparatus of claim 10, wherein: 
said cue commands are provided in a transport 

layer of said digital spliceable data stream 
thereof . 



16. The apparatus of claim 10, wherein: 
cue commands are provided in said digital 
spliceable data stream regardless of a presence of 
said cue tones according to a real-time trigger or a 
scheduler/controller . 



17. The apparatus of claim 10, wherein: 
said cue commands designate desired program 

attributes of the inserted commercial . 

18. The apparatus of claim 10, wherein: 
the digital spliceable data stream is a 

constant bit rate or a variable bit rate stream. 
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